-
Notifications
You must be signed in to change notification settings - Fork 28.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-6546][Build] Using the wrong code that will make spark compile failed!! #5198
Conversation
merge lastest spark
merge lastest spark
merge lastest spark
merge lastest spark
merge lastest spark
merge lastest spark
merge lastest spark
Can one of the admins verify this patch? |
i think this is pressing @marmbrus |
Jenkins, this is ok to test. |
Do you know which PR broke this? |
@JoshRosen It should be #4289. |
Test build #29206 has started for PR 5198 at commit
|
�This LGTM pending Jenkins. #4289 somehow passed Jenkins, however the build history has been cleaned now. |
@JoshRosen @marmbrus #4289 was using Guava's |
Test build #29206 has finished for PR 5198 at commit
|
Test PASSed. |
you are right @liancheng |
…atch table schema In hive,the schema of partition may be difference from the table schema.When we use spark-sql to query the data of partition which schema is difference from the table schema,we will get the exceptions as the description of the [jira](https://issues.apache.org/jira/browse/SPARK-5498) .For example: * We take a look of the schema for the partition and the table ```sql DESCRIBE partition_test PARTITION (dt='1'); id int None name string None dt string None # Partition Information # col_name data_type comment dt string None ``` ``` DESCRIBE partition_test; OK id bigint None name string None dt string None # Partition Information # col_name data_type comment dt string None ``` * run the sql ```sql SELECT * FROM partition_test where dt='1'; ``` we will get the cast exception `java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.MutableLong cannot be cast to org.apache.spark.sql.catalyst.expressions.MutableInt` Author: jeanlyn <jeanlyn92@gmail.com> Closes #4289 from jeanlyn/schema and squashes the following commits: 9c8da74 [jeanlyn] fix style b41d6b9 [jeanlyn] fix compile errors 07d84b6 [jeanlyn] Merge branch 'master' into schema 535b0b6 [jeanlyn] reduce conflicts d6c93c5 [jeanlyn] fix bug 1e8b30c [jeanlyn] fix code style 0549759 [jeanlyn] fix code style c879aa1 [jeanlyn] clean the code 2a91a87 [jeanlyn] add more test case and clean the code 12d800d [jeanlyn] fix code style 63d170a [jeanlyn] fix compile problem 7470901 [jeanlyn] reduce conflicts afc7da5 [jeanlyn] make getConvertedOI compatible between 0.12.0 and 0.13.1 b1527d5 [jeanlyn] fix type mismatch 10744ca [jeanlyn] Insert a space after the start of the comment 3b27af3 [jeanlyn] SPARK-5498:fix bug when query the data when partition schema does not match table schema
@DoingDone9 Would you mind to add your name to JIRA and GitHub, so that we can include your name in the credit list of the next release? Also, please add your name in your local Git configuration:
|
Merged into master, thanks! |
ok i will change @liancheng |
wrong code : val tmpDir = Files.createTempDir()
not Files should Utils